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3 (Original) A facial expression transformation method comprising: 
ining a code book containing data defining a first set of facial 
IS of a first person; 

prwiding data defining a second set of facial expressions, the second set of 
facial expressions providing V training set of expressions of a second person who 
is different from the first persdn; 

deriving a transformatipp fiinction from the training set of expressions and 
corresponding expressions ftomUhe first set of expressions; and 

^plying the transfomiafton function to the first set of e3q)ressions to 
provide a synthetic set of expressions. 

2. (Original) The methbd of claim 1, wherein the training set of 
expressions contains fewer cxpressidns than the code book. 

3, (Original) The method\of claim 1, wherein the transformation 
flmction compensates for differences iA the size and shape of the faces of the first 
and second persons. \ 

4. (Original) The method of flJaim 1, wherein said deriving of the 
transfonnation fimction comprises computipg a linear transformation from one set 
of expressions to another, \ 

5, (Original) The method of claim\ 1. wherein the deriving of the 
transfomiation function comprises: \ 
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representing each Wpression as a 3/w-vector that contains x, y, z 
displacements at m standard Wnplc positions; and 

computing a set of liniar predictors fly, one for each coordinate of given 
a set of n expression vectwp for a face to be transformed, and a 

corresponding set of vectors fir a target face, &;„ by solving 3m linear least 
'^'iquares systems of the foUowingVorm: 
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6. (Canceled). 

7- (Canceled). 

8. (Canceled). 

9. (Canceled). 



10. (Original) T|ie mediod of claim 1, wherein said providing data 
defining a second set of facial expressions coriiprises: 

illuminating the second person's face with illumination; and 
contemporaneously capturing structure oata describing the face's structure 

and reflectance data describing reflectance pi(operties of the face from the 

illumination. 

11. (Canceled). 
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12- (Canceled). 



13. (Cano 




14. (Canceled) 



15. (Canceled) 




18. (Canceled). 



19. (Original) One or more computer-readable media having computer- 
readable instructions thereon which, when executed by a computer, cause the 
computer to: 

operate on a training set of expressions fr^m one person and corresponding 
expressions from a code book of another toerson to compute a linear 
tiansforaiation function from the training set and th)^ir corresponding expressions; 
and 

apply the transformation function to a plurali^ of expressions from the 
code book to provide a synthetic set of expressions. 
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20, (Original) ThA computeweadable media of claim 19, wherein the 
instructions cause tfie computbr to use the synthetic set of expressions to transform 
expressions from the one persota into expressions of the other person. 

2L (Original) The computer-readable media of claim 20, wherein the 
instructions cause the computer td transform expressions from the one person that 
are different from those expressioM comprising the code book expressions. 

22. (Original) The computer-readable media of claim 20, wherein the 
instructions cause the computer to transform expressions by transmitting at least 
one index of a synthetic expression^ to a receiver that can reconstruct the 
expression, 

23- (Original) The computer-reaaable media of claim 20, wherein the 
instructions cause the computer to transform Vacial expressions- 

24, (Original) A facial expression transformation system comprising: 

a code book embodied on a computer-readable medium, the code book 
containing data defining a first set of facial expre^ions of a first person; 

data embodied on a computer-readable me^um, the data defining a second 
set of facial expressions, the second set of facial expressions providing a training 
set of expressions of a second person who is different from the first person; and 

a transformation processor configured to derive a transformation fimction 
from the training set of expressions and corresponding expressions from the first 
set of expressions. 
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25- (Original) Tne expression transformation system of claim 24, 
wherein the transfomiation jbroeessor comprises a linear transformation processor. 



5 
6 
7 
8 

ID 
il 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



26. (Origmal) The expression transfomiation system of claim 24 further 
comprising a synthetic set of expressions embodied on a computer-readable 
medium, the synthetic set of e?cpressions being derived by applying the 
transformation function to the code book expressions. 

27. (Origmal) The expitession transfomiation system of claim 24» 
wherein the transfomiation funotioin compensates for differences in the size and 
shape of the faces of the first and second persons. 

28. (Original) The expression transfomiation system of claim 24, 
wherein the transformation processor derives the transformation function by: 

representing each expression as a 3m-vector that contains x, y, z 
displacements at m standard sample pc^itionsl and 

computing a set of linear predictors aj, one for each coordinate of go, given 
a set of n expression vectors for a face to be transformed, gaL„n7 ^ 
corresponding set of vectors for a target face, i^/.../}, by solving 3m linear least 
squares systems of the following form: 

29. (Original) A facial expression transformail^on system comprising; 
a transmitter comprising: 
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a facial illinnination sVstem that is configured to provide multiple different 
light sources at the same timeVor illuminating a subject's face; 

a data-capturing systelh configured to capture both structure data and 
^flectance data ftom the subject's face when illuminated by the facial 

illumination system; and \ 

a first code book of syntheic expressions that have been synthesized by: 
receiving a training set of eLessions provided by the subject; 
computing a transformation Uction using the training set of expressions 
and corresponding unsynthesized co<4 book expressions; and 

applying the transformation function to all of the expressions in the code 

book; and \ 

a receiver communicatively linkei with the transmitter and comprising: 

a reconstruction module for reconsLoting facial images; and 
a second code book containing theVame synthetic expressions as the first 

code book; and \ 
the transmitter being configured to: \ 

capture additional expressions of the subject; 

search the first code book for a corresponding or near matching expression; 

and \ 

transmit an index of a corresponding or mWhing code book expression to 

the receiver for facial image reconstruction by the Construction module. 

30. (Original) The expression transformkion system of claim 29, 
wherein the iUumination system comprises at least oneVolarized light source. 
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31. (Original) The Wpression transfonnatioii system of claim 29, 
wherein the illumination systenl comprises multiple polarized light sources. 

32- (Original) The egression transformation system of claim 29, 
wherein the illumination system comprises a patterned light source configured to 
project a pattern onto the subject's mce. 

33. (Original) The expression transformation system of claim 29, 
wherein the illumination system coipprises an infrared patterned light source 
configured to project a pattern onto the subject's face. 

34. (Original) The expression \ transformation system of claim 29, 
wherein the different light sources are ail irffi^d light sources. 

35. (Original) A method of animating facial features comprising: 
defining a subdivision surface that approximates geometry of a plurality of 

different faces; and \ 

fitting the same subdivision surface to eadh of the plurality of faces. 

36. (Original) The method of claim 35, wherein said defining comprises 
defining the subdivision surface with a coarse meshVtructure. 

37. (Original) The method of claim 36Awherein the coarse mesh 
structure comprises a triangular mesh. \ 
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38. (Original) The method of claim 35, wherein said fitting comprises 
perfomiing a continuous optimization operation over vertex positions of the 
subdivision surface. 1 

39. (Original) The method qf claim 35, wherein said fitting comprises 
fitting the subdivision surface to the fdces without altering the connectivity of a 
mesh that defines the subdivision surface. 

40. (Original) The method of claim 35, wherein said fitting comprises 
minimizing a smoothing functional associated with a mesh that defines the 
subdivision surface. \ 

41. (Origmal) The method of claim 35, wherein said fitting comprises 
selecting one or more constraints associat^ witfi a mesh that defmes the 
subdivision surfece and fitting those constraints directly to corresponding points 
on the faces. \ 

42. (Original) The method of claim 41, wherein the constraints are 
associated with one of the eyes, nose and mouth. \ 

43. (Original) The method of claim 35, wherein said fitting comprises 
minimizing a fiinctional that includes terais for qistance, smoothness, and 
constraints. \ 
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44. (Original) The method of claim 35, wherein said fitting comprises 
solving a sequence of linear least-squares problems. 

45. (Original) One or more computer-readable media having computer- 
readable instructions thereon which, when executed by one or more computers, 
cause the one or more comAiters to implement the method of claim 35. 

46. (Original) A mettiod of animating facial features comprising: 
defming a subdivision stuface that ^proximates geometry of a plurality of 

different faces; \ 

fitting the same subdivisiim surface to each of the plurality of faces to 
establish a correspondence betweeAthe faces; and 

using the correspondence beween the faces to transform an expression of 
one face into an expression of anotherVace- 

47. (Original) A method of animating facial features comprising: 
measuring 3-dimensional data for a plurality of different faces to provide 

corresponding face models; \ 

defining only one generic face modeluhat is to be used to map to each 
corresponding face model; \ 

selecting a plurality of points on the geiieric face model that are to be 
mapped directly to corresponding points on eaJth of the corresponding face 
models; and \ 
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fitting the generic face model to each of the corresponding face models, 
said fitting comprising nJapping each of the selected points directly to the 
corresponding points on eacn of the corresponding face models* 

48- (Original) The liethod of claim 47, wherein: 

said defining comprises defining a subdivision surface from a base mesh 
structure, the subdivision surface containing a plurality of vertices and 
approximating the geometry of the face models; and 

said fittmg comprises manbulating only the positions of the vertices of the 
subdivision surface. \ 

49- (Original) The method\of claim 47, wherein said fitting comprises 
manipulating a base mesh that defines a subdivision surface. 

50. (Original) The method of Vlaim 47, wherein said fitting comprises 
maniptilating a base mesh that defines a subdivision surface witfiout altering the 
connectivity of the base mesh. \ 

51. (Original) The method of claim 47, wherein said measuring 
comprises using a laser range scan to measure the 3-diraensional data. 

52. (Re-presented — formerly dependent iclaim 6) A facial ejcpression 
transformation method comprising: \ 

defining a code book containing data defming a first set of facial 
e;q>ressions of a first person; \ 
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providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the firsA person; 

deriving a transfomiation function from the training set of expressions and 
corresponding expression^ from the first set of expressions, wherein the deriving 
of the transformation function comprises; 

representing each expression as a 3w-vector that contains x, y, z 
displacements at m st^dard sample positions; and 

computing a seftof linear predictors aj, one for each coordinate of g^, 
given a set of n expression vectors for a face to be transformed, gaj,„ni wd a 
corresponding set of veAtors for a target face, g^^.w* by solving 3m linear 
least squares systems of the following form: 
ajgm\^gb,\j],i^l..jt, 
wherein said computmg comprises using only a subset of points for 
each gay; and \ 

applying the transformation fhinction to the first set of expressions to 
provide a synthetic set of expressions. \ 

53. (Re-presented — formerly d^endent claim 7) The method of claim 
52) wherein said using comprises using only points that share edges with a 
standard sample point under consideration. \ 

54. (Re-presented— formerly dependent claim 8) A facial expression 
transformation method comprising: \ 
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aefi^g . code boo\<-»^«tog data defining a to. set of fcda. 
aqwessionsofafitstpeison; 

p^vidtog data defining .U«<1 of fecial repressions, .he second set of 
faei^ expression p^viding a J^g ^ of exp^ssion, of a second person who 

is different from the first person: 
. , acriving a transfonoati^. flJUon fion. the training set of expressions and 
J eo^sponding expressions fiom««ys. set of expressions. «hereh.*ederi™g 

8 ofthetransfonnationfimctioncompri 

t _A„:^„ <ae a Im-vector that contains x, y, z 
representing each expreision as a 3m-vecior 

displacements at m standard samWe positions; and 

computing a set of linear Ldictor. a, one for each coordinate of 
given a set of « egression vectori for a face to be transformed, g^^^^^^ 

corresponding set of vectors for aW fi.ce, g....„. by solving 3. linear 
least squares systems of the foUowjig form: 

controlling spread of ^ values when computing a 
pseudoinverse to solve fcr the fl/; and 

applying the transformation flmcdony the first set of expressions to 
„| provide a synthetic set of expressions. 

55 (Re.pre«nted-formerly dependenV dafan 9) The method of claim 
54. wherein said controUing the spread comprisesUoing out aU singular v^ues 
less than ao,. where a, is the largest singular value if the matrix. 



21 



24 



25 



13 



Received(rom<5(l9 323 8979>at«26l031:31:11PM|Ea8temDayli9MT^^^ 



JLIM 26 2003 10:37 FR LEE - HPYES PLL 509 323 8979 TO 17038729314 



P, 16/35 



2 
3 
4 
S 
6 
7 
S 
9 
10 
11 
12 
12 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



56. (Re-presented — formerly dependent claim 11) A facial expression 
transformation method comprising: 

defining a code Book containing data defining a first set of facial 
expressions of a first persor 

providing data definiAg a second set of facial expressions, the second set of 
facial expressions providmg k training set of ejqjressions of a second person who 
is different from the first persdb, wherein said providing data defining a second set 
of facial expressions comprises! 

illummating the \second person's face with illumination, said 
illuminating comprising: 

using multiple light\sources, one of v/hich projecting a pattern on the 
second person's face from Miich the structure data can be ascertained; 

at least one of the light sources comprising an infrared light source; 
at least one of the light sources being polarized; and 
contemporaneously capturing structure data describing the facets 
structure and reflectance data\describing reflectance properties of the face 
from the illumination, said camuring comprising using a camera having a 
polarizer that suppresses specularly-reflected light so that diffuse 
component reflection data is capnircd; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation fimctton to the first set of expressions to 
provide a synthetic set of expressions. 
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57. (Re-pi«entedr— ftemerly dependent claim 12) A facial e>q>ression 
transformation method comprising: 

defining a code book dbntaining data defining a first set of facial 
expressions of a first person; \ 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different fi^m the first person, , wherein said providing data definmg a second 
set of facial expressions comprises: \ 

illuminating the second person's face with a first polarized light 
source that is selected so that specularly-suppressed reflective properties of 
the face can be ascertained; \ 

illuminating the second parson's face with a second structured light 
source that projects a pattern! onto the face, while simultaneously 
illuminating the face with the first iolari2ed ligjit source; and 

capturing both specularly-suppressed reflection data and structure 
data firom the shnultaneous illuminafion; 

deriving a transformation function from the training set of expressions and 
corresponding expressions firora the first set of expressions; and 

applying the transformation fimctiom to the first set of expressions to 
provide a synthetic set of expressions. \ 

58. (Re-presentedr~formeriy dependent claim 13) The method of claim 
57, wherein the light sources provide light at different firequencies^ 
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59. (Re-presented^wrraerly dependent claim 14) The method of claim 
57, wherein the light sources provide infrared light, 

60* (Re-presented— formerly dependent claim 15) The method of claim 
57, further comprising processing me captured data to provide both (a) data that 
describes dimensional aspects of i(ie face and (b) data that describes dififiise 
reflective properties of the face. 

6L (Rc^presented — formerly \ dependent claim 16) A facial expression 
transformation method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second seAof facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person'^ face with multiple different light 

sources; 

measuring range map data from sak illuminating; 
measuring image data from said illiikninating; 
deriving a 3-dimensional surface from the range map data; 
computing surface normals to the 3-dimensional surface; and 
processing the surface normals and the image data to derive an 
albedo map; 
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deriving a transfonnation ninction from the training set of oqpressions and 
corresponding expressions from tlte first set of expressions; and 

applying the transformatiom fimction to tiie first set of expressions to 
provide a synthetic set of cxprcssioife. 



62, (Re-presented — ^formerly dependent claim 17) The method of claim 
61, wherein at least one of the light soikces is polarized. 



63, (Re-presented — formerly dependent claim 18) The method of claim 
61, wherein all of the light sources are poWized. 
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